Managing lifecycles of television gadgets and applications

ABSTRACT

The subject matter of this specification can be embodied in, among other things, a method that includes identifying metadata related to television programming. The method further includes sending search requests that include the identified metadata to a search system for selecting at least one portable program module. The method further includes in response to a first one of the search requests, receiving first search results from the search system that identify the selected portable program module and outputting a representation of the selected portable program module to a display device for presentation concurrently with the television programming. The method further includes in response to a second one of the search requests, receiving second search results from the search system that no longer identify the selected portable program module and ceasing the output of the representation of the selected portable program module.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/390,574, filed Apr. 22, 2019, which is a continuation of U.S. patentapplication Ser. No. 15/728,274, filed Oct. 9, 2017, which is acontinuation of U.S. patent application Ser. No. 14/868,237, filed Sep.28, 2015, which is a continuation of U.S. patent application Ser. No.13/104,593, filed May 10, 2011, which claims the benefit of U.S.Provisional Patent Application No. 61/346,286, filed May 19, 2010, eachof which is hereby incorporated by reference herein in its entirety.

TECHNICAL FIELD

This instant specification relates to managing lifecycles of televisionbased gadgets and applications.

BACKGROUND

Many people like to multi-task while watching television. In some cases,a person may like to surf the web or chat with friends while watchingtelevision. In some cases, a person may play a game while watchingtelevision. These activities sometimes draw viewers away from televisionto their personal computer, cell phone, game console, or other networkconnected device.

Sometimes, computer users interact with gadgets (also called widgets)while surfing the web. Gadgets are generally written in a web markuplanguage, such as Hypertext Markup Language (HTML) or ExtensibleHypertext Markup Language (XHTML). Typically, gadgets can be runsuccessfully on various types of devices, as long as those devices canexecute the relevant mark-up language. These gadgets generally includeor make use of a web programming or scripting language, such asJavaScript. Gadgets are becoming commonplace in web pages, such associal networking sites and customized home pages. Gadgets are alsocommonplace in desktop applications, such as desktop sidebarapplications.

Some enhanced television systems, such as WINK, OPENTV, ADVANCEDTELEVISION ENHANCEMENT FORUM (ATVEF), YAHOO WIDGETS, and OPENCABLEAPPLICATION PLATFORM (OCAP), can display gadgets or other Internetcontent on top of television content. In some cases these systems usetriggers built into the audio/video signal to link particular televisionshows or advertisements with a specific interactive application. Thesesystems can associate an application with a particular point of aparticular program.

SUMMARY

In general, this document describes selecting portable program modules,such as gadgets and/or applications, to be combined with televisionviewing based on the program currently watched and/or the preferences ofthe viewer. In one aspect, a computer-implemented method for managing alifecycle of a portable program module includes repeatedly identifyingmetadata related to television programming being presented on a displaydevice. The method further includes repeatedly sending search requeststhat include the repeatedly identified metadata to a search system forselecting at least one portable program module from among multipleportable program modules. The method further includes in response to afirst one of the search requests, receiving first search results fromthe search system that identify the selected portable program module andoutputting a representation of the selected portable program module tothe display device for presentation concurrently with the televisionprogramming. The method further includes in response to a second one ofthe search requests, receiving second search results from the searchsystem that no longer identify the selected portable program module andceasing the output of the representation of the selected portableprogram module.

Implementations can include any, all, or none of the following features.The method including repeatedly detecting changes in the repeatedlyidentified metadata, and wherein the second one of the search requestsis sent upon detecting a change in the repeatedly identified metadata.The method including between sending the first and second searchrequests, receiving a user request to change from a first televisionchannel to a second television channel. The first metadata includes anidentifier of the first television channel and the second metadataincludes an identifier of the second television channel, and whereinrepeatedly identifying the metadata includes identifying the firsttelevision channel and the second television channel. The first metadataincludes a first television program identifier and the second metadataincludes a second television program identifier. The method includingreceiving the selected portable program module from the search system.Selecting the portable program module includes selecting one or more ofthe portable program modules having a closest match with the firstmetadata. Selecting the portable program module includes selecting oneor more most popular ones of the portable program modules. The selectedportable program module includes an advertisement. The first and secondmetadata include closed captioning information for the televisionprogramming. The method including decoding the closed captioninginformation from the television programming. The first and secondmetadata can include text or objects recognized from an audio/videosignal in the television programming. Outputting the representation ofthe selected portable program module to the display device includescombining the representation of the selected portable program modulewith the television programming and outputting the combination to thedisplay device.

In one aspect, a computer program product, encoded on acomputer-readable medium, operable to cause one or more processors toperform operations for managing a lifecycle of a portable program moduleincludes repeatedly identifying metadata related to televisionprogramming being presented on a display device. The operations furtherinclude repeatedly sending search requests that include the repeatedlyidentified metadata to a search system for selecting at least oneportable program module from among multiple portable program modules.The operations further include in response to a first one of the searchrequests, receiving first search results from the search system thatidentify the selected portable program module and outputting arepresentation of the selected portable program module to the displaydevice for presentation concurrently with the television programming.The operations further include in response to a second one of the searchrequests, receiving second search results from the search system that nolonger identify the selected portable program module and ceasing theoutput of the representation of the selected portable program module.

Implementations can include any, all, or none of the following features.The operations including repeatedly detecting changes in the repeatedlyidentified metadata, and wherein the second one of the search requestsis sent upon detecting a change in the repeatedly identified metadata.The operations including between sending the first and second searchrequests, receiving a user request to change from a first televisionchannel to a second television channel. The first metadata includes anidentifier of the first television channel and the second metadataincludes an identifier of the second television channel, and whereinrepeatedly identifying the metadata includes identifying the firsttelevision channel and the second television channel. The first metadataincludes a first television program identifier and the second metadataincludes a second television program identifier. The operationsincluding receiving the selected portable program module from the searchsystem. Selecting the portable program module includes selecting one ormore of the portable program modules having a closest match with thefirst metadata. Selecting the portable program module includes selectingone or more most popular ones of the portable program modules. Theselected portable program module includes an advertisement. The firstand second metadata include closed captioning information for thetelevision programming. The operations including decoding the closedcaptioning information from the television programming. The first andsecond metadata can include text or objects recognized from anaudio/video signal in the television programming. Outputting therepresentation of the selected portable program module to the displaydevice includes combining the representation of the selected portableprogram module with the television programming and outputting thecombination to the display device.

In one aspect, a computer-implemented system for managing a lifecycle ofa portable program module includes at least one input interface thatreceives television programming. The system further includes a decoderthat repeatedly extracts metadata from the received televisionprogramming. The system further includes at least one network interfacethat sends search requests including the extracted metadata to a searchsystem and, in response, repeatedly receives search results from thesearch system, including an initial set of search results identifying atleast one portable program module. The system further includes aportable program module manager that generates the search requests usingthe extracted metadata, outputs a representation of the identifiedportable program module to a display device for presentationconcurrently with the television programming, and then ceases the outputof the representation of the identified portable program module uponreceipt of a subsequent set of search results that no longer identifiesthe portable program module.

Implementations can include any, all, or none of the following features.The system including at least one output interface to output theportable program module to the display device.

The systems and techniques described here may provide one or more of thefollowing advantages. First, a system can provide for activatingportable program modules that will satisfy the multitasking demands of auser on a television display device. Second, a system can provide a lifecycle of a television portable program module that is synchronized withthe television content. Third, a system can provide a life cycle of atelevision portable program module that is not vulnerable tobroadcasters or operators removing specialized triggers that control thelife cycle of the television portable program module.

The details of one or more implementations are set forth in theaccompanying drawings and the description below. Other features andadvantages will be apparent from the description and drawings, and fromthe claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram that shows an example of a system formanaging the lifecycle of television portable program modules.

FIG. 2 is a schematic diagram that shows an example of a system formanaging the lifecycle of television portable program modules.

FIG. 3 is a block diagram that shows an example of a portable programmodule management device.

FIG. 4 is a flow chart that shows an example of a process for managingthe lifecycle of television portable program modules.

FIG. 5 is a schematic diagram that shows an example of a computingsystem.

DETAILED DESCRIPTION

FIG. 1 is a schematic diagram that shows an example of a system 100 formanaging the lifecycle of television portable program modules. Thesystem 100 is used to present portable program modules to a user. Theportable program modules are related to television programming currentlybeing presented to the user. Portable program modules can include, forexample, gadgets and/or applications. Gadgets are small interactiveapplications written in a markup language, such as Hypertext MarkupLanguage (HTML) or Extensible Hypertext Markup Language (XHTML). Gadgetsare sometimes also referred to as widgets. In some implementations, agadget is an iframe HTML element embedded within a container document orweb page. In another implementation, a gadget can be a standalone webpage. Applications are often written using a programming language, suchas JAVA or OBJECTIVE C. The written programming is then compiled into anapplication by a compiler, either sometime prior to running theapplication, at runtime, or some combination of before runtime and atruntime. Often, the written programming is first compiled into bytecode,which is hardware independent. The bytecode may then be run by a virtualmachine, such as the JAVA VIRTUAL MACHINE or the DALVIK VIRTUAL MACHINE.

The visual and audible output of the portable program modules can beshown superimposed on the television programming or, in the case ofvideo, around the television programming. For example, visual output canbe shown in the blank space that exists where the aspect ratio oftelevision programming content does not match the aspect ratio of thedisplay device presenting the television content.

In some implementations, the portable program modules are presented on adisplay device that is separate from the device that presents thetelevision programming. Whether on the same display device or a separatedisplay device, the portable program modules are presented to the userwhile the television programming content is presented to the user. Theseportable program modules can provide a user with functionality relatedto the television content the user is currently viewing, such aschatting with other viewers, access to fan websites, or targetedadvertising.

The system 100 includes a television programming display device 102, atleast one television programming provider 104, and a portable programmodule management device 106. The television programming display device102 is an electronic device used to display television programming. Forexample, the television programming display device 102 can be atelevision, computer monitor and speakers, portable video player, orsmart phone.

The television programming display device 102 presents televisionprogramming provided by the television programming provider 104. Thetelevision programming can include, for example, television shows,movies, and/or commercials. The television programming provider 104sends the television programming to the television programming displaydevice 102 over a wire line connection, such as cable television ortelevision provided by a telephone company, or a wireless connection,such as broadcast television or satellite television.

The portable program module management device 106 monitors thetelevision content being displayed by the television programming displaydevice 102 and displays one or more portable program modules that arerelated to the television programming currently being displayed to theuser. In some implementations, the portable program module managementdevice 106 controls the tuning of television channels and/or playback ofother television programming. For example, the user can send a commandto the portable program module management device 106 using a wire lineor wireless input device, or a button directly on the portable programmodule management device 106, that requests presentation of a specificchannel, navigating up or down a channel, a particular video on demand(VOD), or playback of recorded programming. Wireless input devices caninclude, for example, an infrared (IR) remote control or BLUETOOTH andWIFI wireless devices, such as a smart phone, mobile computer, or adesktop computer. Wire line input devices can include, for example,computing device connected to the portable program module managementdevice by a local area network (LAN) or the Internet. The portableprogram module management device 106 receives the request to change thechannel and tunes in the requested channel or retrieves the requestedvideo on demand or recorded programming.

Alternatively, the portable program module management device 106 canreceive the channel change command and pass the channel change commandon to an external tuner, such as through an HDMI connection to a tunerin a cable television set-top box 105 a or a satellite televisionset-top box 105 b. In another example, the portable program modulemanagement device 106 can send commands to an external tuner using awireless connection, such as IR. In another example, the portableprogram module management device 106 and one or more of the set-topboxes 105 a-b can communicate using a network, such as a local areanetwork or the Internet. The portable program module management device106 then receives the video and/or audio for the tuned-in channel fromthe external tuner.

In another external tuner example, the channel change commands may besent directly to the external tuner or other external programmingdevice, such as a digital video recorder (DVR). The portable programmodule management device 106 may then receive the tuned-in channel orother audio/video signal from the external tuner or programming device.The portable program module management device 106 subsequently processesthe received programming to identify the metadata. In someimplementations, the portable program module management device 106 canmonitor a wire line or wireless connection to the externaltuner/programming device to identify programming change commands sent tothe external tuner/programming device. For example, the portable programmodule management device 106 can include an IR receiver for monitoringIR commands sent to an external device.

Whether by an internal tuner, an external tuner, programming on demand,or recorded programming, the portable program module management device106 decodes or identifies metadata for the programming. The metadata isused by the system 100 to select one or more portable program modulesrelated to the content being presented. The metadata may be in-band withthe audio/video signal or out-of-band. For example, the portable programmodule management device 106 can extract in-band closed captioning text,station identification information, or television program identificationinformation from the audio/video. In another example, metadata may bestored out of band with recorded programming, such as a file name orfile attributes. In another out of band example, the portable programmodule management device 106 can retrieve electronic program guide (EPG)data or a transcript for a particular show, channel, and/or time slotfrom an internal storage at the portable program module managementdevice 106 or an external storage, such as the set-top boxes 105 a-b ora computing device on the same network as the portable program modulemanagement device 106 or on the Internet.

In yet another example of identifying metadata, the portable programmodule management device 106 or another system can perform speechrecognition on the audio to identify text or image recognition on thevideo to recognize text or objects. For example, a system incommunication with the portable program module management device 106 canstore identifying information for television programming, such as aname, channel, broadcast date/time, or a portion of the audio/video. Thesystem can also store pre-recognized transcripts of audio and/orpre-recognized text or objects for television programming. The systemcan compare the stored identifying information to correspondinginformation for the television programming being presented to the userto determine what television programming the user is currently watching.The system can then retrieve a pre-recognized transcript of the audioand/or pre-recognized text or objects from the video for the identifiedtelevision programming.

The portable program module management device 106 combines anaudio/video representation of the portable program modules with theaudio/video signal for the tuned-in channel. For example, the portableprogram module management device 106 can overlay video for the selectedportable program modules on top of or adjacent to the existing video forthe tuned-in channel. In some implementations, the portable programmodule management device 106 uses a split screen to display the existingvideo on one side of the split and the portable program modules on theother. In some implementations, the portable program module managementdevice 106 overlays audio for the portable program modules onto theexisting audio. The portable program module management device 106 thenpasses the altered audio/video on to the television programming displaydevice 102 for presentation to the user.

In the examples above, the portable program module management device 106is a stand-alone electronic device connected to the televisionprogramming display device 102 (and in some cases an external tuner).However, in some implementations, the portable program module managementdevice 106 can be a component incorporated within a televisionprogramming display device or an external tuner. In general, whether theportable program module management device 106 is a stand-alone device orintegrated within another device, as the television programming beingdisplayed to the user changes, the portable program module managementdevice 106 updates the portable program modules presented to the user.

Television programming changes can include, for example, a change in thechannel, a change in the television program (e.g., the channel mayremain the same, but a new television program may be presented at aparticular time of day), or a change within a television program (e.g.,a new guest appears on stage during a talk show television program).Updates to the portable program modules being presented can include, forexample, presenting a new portable program module, no longer presentinga previously presented portable program module, or changing the contentwithin a portable program module.

The portable program module management device 106 creates a search query110 using the metadata from the in band and/or out of band sources. Themetadata is based on the television content being displayed on thetelevision programming display device 102. The search query 110 caninclude information about the television programming, such as actors andactresses shown, programming genre, closed captioning text and/or otherinformation. The portable program module management device 106 sends thesearch query 110 to a search system 108 through a network 118, such asthe Internet. In some implementations, the portable program modulemanagement device 106 can send the metadata to the search system 108.The search system 108 can then create the search query 110. In someimplementations, the search system 108 creates and sends multipleproposed search queries to the portable program module management device106. The portable program module management device 106 presents theproposed search queries to the user and the user can select a searchquery to perform. The portable program module management device 106 thensends the selected search query to the search system 108.

In response to receiving the search query 110, the search system 108performs a search of network application data, such as web pages,gadgets, applications, or other files, accessible over the network 118.In some implementations, the search system 108 provides the results ofthe search to the portable program module management device 106 assearch results 112. The search results 112 can include, for example, alist of portable program modules having attributes that match terms inthe search query 110. The search results 112 can include a reference toa portable program module stored at a network application data provider114. The search system 108 can order the portable program modules in thelist of the search results 112 based users' ratings of the individualportable program modules, preferences of the user associated with theportable program module management device 106, and/or viewership ornumber of downloads for the individual portable program modules.

Alternatively, the search system 108 can provide a portable programmodule identified in the search results 112 to the portable programmodule management device 106. For example, the search system 108 canreceive the portable program module from the network application dataprovider 114 and forward the portable program module to the portableprogram module management device 106.

In some implementations, the search system 108 receives and storesportable program modules prior to receiving the search query 110. Thiscan remove an additional trip over the network 118 (to the networkapplication data provider 114) at the time when the portable programmodule is provided to the portable program module management device 106.

The network application data provider 114 is a computing system, such asa web server or other network accessible computing system. The networkapplication data provider 114 stores one or more portable programmodules, including one or more of the portable programming moduleslisted in the search results 112. The network application data provider114 can send a network application data 116 over the network 118 to theportable program module management device 106. For example, the networkapplication data provider 114 can send the network application data 116to be processed by a portable program module presented by the displaydevice 102.

In addition to sending the search query 110 to the search system 108,the portable program module management device 106 can search data storedlocally at the portable program module management device 106 using thesearch query 110. For example, the portable program module managementdevice 106 can search within portable program modules that have alreadybeen downloaded and/or installed at the portable program modulemanagement device 106. The local search results can include links foropening or initiating the existing portable program modules that satisfythe search query 110. The portable program module management device 106can also search user data at the portable program module managementdevice 106 for portable program modules that satisfy the search query110. For example, the portable program module management device 106 mayinclude bookmarks or shortcut links to portable program modules and theportable program module management device 106 can search the bookmarksand/or shortcuts for portable program modules matching the search query110. The portable program module management device 106 can, in someimplementations, display local search results immediately and displayssearch results from the search system 108 as they arrive at the portableprogram module management device 106.

The portable program module management device 106 generates new searchqueries when the television programming shown on the televisionprogramming display device 102 changes—such as when the channel ischanged, a different television program is presented, or when a changeoccurs within a television program.

In one example, a user is watching an instructional cooking televisionprogram called “Cooking with Sparky.” In this example, the televisionprogramming provider 104 is a local public broadcasting station. Thetelevision programming display device 102 in this example is atelevision that receives the television programming from the portableprogram module management device 106 through an over-the-airtransmission. The portable program module management device 106 recordsand stores information about the channel that is currently selected byand displayed to the user.

In some implementations, the portable program module management device106 receives information about the specific television program that isbeing displayed, such as a title of the television program. For example,the portable program module management device 106 can receive electronicprogram guide (EPG) information from a server system over the network118. In another example, the portable program module management device106 can receive closed captioning (CC) information or other informationwithin the signal or separately from the signal from the televisionprogramming provider 104 or another system. In some implementations, theEPG and CC information is retrieved from metadata in a broadcast signal,such as the metadata in the Vertical Blanking Interval or the metadataprovided by the Program and System Information Protocol (PSIP). EPGmetadata can include, for example, a title of the television program, adescription of the television program, the channel name and/or number,and the time interval and date for the broadcast of the televisionprogram. CC metadata can include, for example, a machine generated ormanual generated transcript of the television program.

In some implementations, the portable program module management device106 can retrieve metadata for the current television program from anexternal source. For example, the portable program module managementdevice 106 can use the identity of the channel and the current time anddate to uniquely identify the television program. The portable programmodule management device 106 can then request the EPG and/or CC datafrom an external source, such as the search system 108 or anothercomputing system on the network 118. Alternatively, the portable programmodule management device 106 can download EPG and/or CC metadata for anumber of channels and television programs prior to the user selecting achannel. The portable program module management device 106 can thensearch for the television program in the local copy of the EPG and/or CCmetadata rather than requesting the metadata at the time the user makesa selection.

Returning to the cooking show example, based on the time, date andprogramming information previously downloaded, the portable programmodule management device 106 can identify that the show being displayedis “Cooking with Sparky.” The portable program module management device106 can generate the search query 110, including terms applicable tothis television program. For example, the search query 110 can includeEPG information that describes the television program, such asinformation identifying the channel as a public broadcasting station,identifying the show as one that often features barbeque cooking, andthat the show is hosted by a former stunt man named Sparky. In someimplementations, the search query 110 can also include information aboutthe user of the television programming display device 102, the hardwareused to output the video, and/or other information. For example, if theviewer indicates a preference for Spanish language translations, thisinformation can be included in the search query 110.

The portable program module management device 106 sends the search query110 over the network 118 to the search system 108. The search system 108performs the search query 110 on an index of portable program modules.The search results 112 include a list of portable program modulesrelated to the television program “Cooking with Sparky” and toproperties of the user or the user's system. The search system 108 sendsthe search results 112 to the portable program module management device106.

In one example, the search results 112 include a portable program modulethat scans closed caption text for cooking measurements and displaystheir conversion values (such as from metric to standard units). Inanother example, the search results 112 include an advertising portableprogram module for a fund raiser held by the public broadcastingstation. The search results 112 may also include a gadget that showsSparky's entry in an online encyclopedia of movies that lists the moviesin which Sparky has participated as a stunt man. In another example, thesearch results 112 include a translator that displays the closedcaptioning text translated into another language.

In some implementations, the search results 112 are sent to the networkapplication data provider 114. The network application data provider 114can then send the portable program module from the search results 112 tothe portable program module management device 106. The portable programmodule management device 106 then processes the portable program modulesand overlays the portable program modules on the audio/video signalpassed to the television programming display device 102.

In some implementations, the television programming display device 102can be a personal computer. For example, the television programmingprovider 104 can be an Internet website operated by a nationalbroadcasting company that streams episodes of television shows. In thisexample, the portable program module management device 106 can beimplemented as software and/or hardware in the personal computer. Theviewer may be watching last week's episode of “Who Knows how to Cook?,”which is a reality television show where contestants battle in aculinary tournament to win a restaurant. The portable program modulemanagement device 106 generates the search query 110 based on metadataabout the show. The search query 110 includes information identifyingthe show as a reality television show, that the current episode featuresbarbeque cooking, and that the show is hosted by famous restaurateurChef Emanuel. The portable program module management device 106 sendsthe search query 110 to the search system 108. The search system 108processes the search query 110 to identify a list of portable programmodules having information that matches the search terms in the searchquery 110 (e.g., gadgets and/or applications related to realitytelevision, barbeque cooking, and/or Chef Emanuel).

For example, the search system 108 can identify a chat program able toconnect the user with a chat room filled other people currently watching“Who Knows how to Cook?” The search system 108 can identify the gadgetthat scans closed captioning text for cooking measurements and displaystheir converted values. The search system 108 can identify a web page ofa restaurant near the user that is owned and operated by Chef Emanuel.The search system 108 sends the list of portable program modules to theportable program module management device 106 in the search results 112.In some implementations, the search system 108 sends links to theportable program modules, such as a Uniform Resource Identifier (URI).The portable program module management device 106 can use the URIinformation in the search results 112 to request portable programmodules from the network application data providers 114 that host one ormore of the portable program modules. In some implementations, thesearch system 108 sends the portable program modules themselves withoutrequiring the portable program module management device 106 to send arequest to retrieve the portable program modules.

FIG. 2 is a schematic diagram that shows an example of a system 200 formanaging the lifecycle of television portable program modules. Thesystem 200 includes a portable program module management device 202 inwire line or wireless communication with a television 204, a personalcomputer 206, and a wireless video player 208. The television 204, thepersonal computer 206, and the wireless video player 208 presentaudio/video data received from the portable program module managementdevice 202, including output from one or more portable program modulesthat the portable program module management device 202 can overlay onthe audio/video data. Other systems including more or fewer videoplayback devices and similar or different types are also possible. Theportable program module management device 202 is also in communicationwith a search system 210 and one or more network application dataproviders 216 a-d over a network 222, such as the Internet.

The search system 210 includes a search engine 212 that processes searchqueries generated by the portable program module management device 202.For example, the search engine 212, or another module or server, maycrawl the network 222 to identify portable program modules that areavailable from the network application data providers 216 a-d over thenetwork 222. Alternatively, the network application data providers 216a-d or other systems can provide information about available portableprogram modules, such as links to the network application data providers216 a-d. In another example, the network application data providers 216a-d can upload applications to the search system 210 for download by theportable program module management device 202 or the portable programmodule management device 202 can retrieve portable program modulesdirectly from the network application data providers 216 a-d. In someimplementations, the search system 210 provides an app store whereapplications can be purchased and then downloaded for use by a device,such as the portable program module management device 202.

The search system 210 stores the portable program module information inan index 214. The index 214 can include information such as a name,keywords, a television channel number, a television channel name, atelevision program name, a time of day, a network address, or otherinformation associated with each portable program module. In someimplementations, the index 214 includes a copy of the portable programmodule allowing the search system 210 to send the portable programmodule directly to the portable program module management device 202.

The network application data providers 216 a-d are computing systemsthat provide access to one or more portable program modules over thenetwork 222. The network application data providers 216 a-d includerespective web servers 218 a-d and one or more web pages 220 a-d. Theweb servers 218 a-d process incoming and outgoing communications. Theweb servers 218 a-d provide interactivity with the web pages 220 a-d.The web pages 220 a-d include data and/or content that are shown in theportable program modules. While some of the web pages 220 a-d may be ina format able to be presented directly by a web browser, such as HTML,some image formats, and JavaScript, other data types may be presentedwithin the browser using plug-ins, such as Java or Flash media.

In one example, the television 204 connected to the portable programmodule management device 202 shows the “Cooking with Sparky” televisionprogram. The portable program module management device 202 can useinformation from the search system 210 to identify a translationportable program module from the network application data provider 216b. The portable program module management device 202 communicates withthe web server 218 b to request the translation portable program modulefrom the web pages 220 b.

In another example, the personal computer 206 (e.g., in another room ofthe same house as the television 204) shows the “Who Knows how to Cook?”television program. The portable program module management device 202can use information from the search system 210 to identify a fan websiteportable program module from the network application data provider 21 6d. The portable program module management device 202 communicates withthe web server 218 d to request the fan page for the “Who Knows how toCook?” television program.

FIG. 3 is a block diagram that shows an example of a portable programmodule management device 300. The portable program module managementdevice 300 accepts inputs, such as a television signal 302 through aninterface 310 and a user channel request 306 through an interface 307.For example, the interface 310 can be a hardware interface such as aconsumer electronics video connection. The interface 307 can be ahardware interface, such as a wireless infrared receiver for a remotecontrol, a wire line network connection to a computing device, or abutton on the portable program module management device 300 itself.

The portable program module management device 300 can receive anaudio/video signal for a television channel that has already been tunedby a tuner that is external to the portable program module managementdevice 300. For example, the portable program module management device300 can receive the user channel request 306 and forward a channelrequest 315 on to the external tuner through an interface 309. Theinterface 309 may be a consumer electronics connection, such as an HDMIconnection or an IR connection. The portable program module managementdevice 300 then receives the television signal 302 from the externaltuner for the channel that was requested in the channel request 315. Insome implementations, the interface 310 and the interface 309 can becolocated or a single interface, such as in an HDMI connection.

As an alternative to an external tuner, the portable program modulemanagement device 300 may include a tuner. The portable program modulemanagement device 300 uses the tuner and the user channel request 306 totune in an audio and video signal 31 1 for a particular televisionchannel. For example the portable program module management device 300can include an Advanced Television Systems Committee (ATSC) tuner, aNational Television Systems Committee (NTSC) tuner, a Sequential Colorwith Memory (SECAM) tuner, a Phase Alternating Line (PAL) tuner, and/ora Digital Video Broadcasting (DVB) tuner. The tuner can allow theportable program module management device 300 to tune one or more ofover the air broadcast television channels, cable television channels,satellite television channels, or channels provided by atelecommunications/telephone company.

In addition to live broadcast by an internal or external tuner, theportable program module management device 300 can receive and/orretrieve recorded television programming or video on demand. In additionto video programming, the portable program module management device 300can receive audio channels or radio as the input signal.

The portable program module management device 300 includes a metadatadecoder 312 that decodes metadata from the television signal 302. Forexample, the metadata decoder 312 can decode certain metadata 313 fromthe television signal 302, such as call letters for the televisionchannel, the name of the television program, closed captioning text ofthe television program, or other metadata included in the televisionsignal 302. The metadata decoder 312 provides the audio and video signal311 for the television program and the metadata 313 for the televisionprogram to a portable program module manager 314. In someimplementations, the portable program module manager 314 receives inband metadata if the interface 309 and/or the interface 310 are analoginterfaces.

In some implementations, the metadata 313 provided to the portableprogram module manager 314 is general purpose information that is notspecifically designed to be a trigger for portable program modules. Forexample, this may allow the portable program module manager 314 to beused with general purpose television programming systems rather than aspecial purpose television programming provider system specificallydesigned for portable program module management.

In some implementations, the portable program module manager 314 canreceive out of band metadata through an interface 316. For example, theinterface 316 can be a network connection to a local area network or theInternet. The portable program module manager 314 can use, for example,a channel identifier, a time of day and date, and television programmingprovider head end information (e.g., a name of the provider and/or alocation of the portable program module management device 300) to accessor retrieve EPG data, transcript data, or other out of band programmingdata related to the television signal 302. In some implementations, theportable program module manager 314 receives out of band metadatathrough the interface 316 if the interface 309 and/or the interface 310are digital interfaces.

The portable program module manager 314 generates a search query 318based on the metadata 313 and/or any out of band metadata. The portableprogram module manager 314 sends the search query 318 to a remotecomputing system through the interface 316. In some implementations, theinterface 316 can be a network interface to the Internet, an intranet,or other computer network.

The remote computing system processes the search query 318 to identifyone or more portable program modules 320. The remote computing systemsends the portable program modules 320 to the portable program modulemanager 314. In some implementations, the portable program modulemanager 314 stores the portable program modules 320 in a portableprogram module storage 322. In some implementations, the portableprogram module storage 322 is a persistent memory, such as a database ina hard drive or flash memory device. In some implementations, theportable program module storage 322 is a non-persistent memory, such asrandom access memory (RAM). The portable program module manager 314 canalso use the search query 318 to search the portable program modulestorage 322 for portable program modules that have already beendownloaded and/or installed at the portable program module managementdevice 300.

In some implementations, where the portable program module manager 314receives multiple portable program modules, the portable program modulemanager 314 presents a list of the portable program modules to the userand allows the user to select one or more of the portable programmodules for display. In some implementations, the portable programmodule manager 314 selects a predetermined number of the portableprogram modules resulting from the search (such as the first one, two,or three portable program modules) for display and provides an optionthat allows the user to select one or more of the additional portableprogram modules for display. In some implementations, the portableprogram module manager 314 selects all of the portable program modulesresulting from the search for display on the television device. Inanother example, the portable program module manager 314 selects enoughportable program modules to fill the space available on the displaydevice and can also provide a user input control to request the displayof additional portable program modules. In another example, the portableprogram module manager 314 can hide or disable a portable program modulethat has not been used or has been inactive for a threshold amount oftime to provide space for other portable program modules.

The portable program module manager 314 combines the audio and videosignal 311 with one or more of the portable program modules 320. Forexample, the portable program module manager 314 can overlay the audioand visual data from the portable program modules 320 on top of thecorresponding components of the audio and video signal 31 1 to producean audio and video signal with portable program module overlay 304. Theportable program module manager 314 outputs the audio and video signalwith portable program module overlay 304 through an interface 324 to adevice such as the television programming display device 102, thetelevision 204, the personal computer 206, or the wireless video player208. In some implementations, the interface 324 includes one or moreconsumer electronics audio/video hardware interfaces, such asHigh-Definition Multimedia Interface (HDMI), Digital Visual Interface(DVI), component video, composite video, Video Graphics Array (VGA)D-subminiature (DSUB), S/PDIF digital audio (e.g., over coaxial cable oroptical fiber, such as TOSLINK), and/or analog audio.

In some implementations, the portable program module manager 314 outputsthe audio and video signal with portable program module overlay 304 overa network interface, such as the interface 316. In addition, theportable program module manager 314 can convert the audio and videosignal with portable program module overlay 304 to a compressed format,such as the MPEG-2 format or the H.264 format. The portable programmodule manager 314 can then send the compressed signal to a computingdevice on the local area network with the portable program modulemanager 314 or to a remote computing device, such as a device connectedto the portable program module manager 314 through the Internet.

Over time the metadata decoder 312 sends updates of the metadata 313 tothe portable program module manager 314. For example, if the user inputsa new channel request, the metadata decoder 312 or the interface 307,can pass the new channel identifier to the portable program modulemanager 314.

In another example, if metadata within the television signal 302indicates that a previous television program has ended and anothertelevision has begun, then the metadata decoder 312 can send thetelevision program status updates to the portable program module manager314. In another example, the portable program module manager 314 candetermine that a television program has ended and a new televisionprogram has begun based on the current channel identifier in themetadata 313 and EPG metadata. In some implementations, the portableprogram module manager 314 retrieves the EPG metadata at runtime from anexternal source. In some implementations, the portable program modulemanager 314 retrieves the EPG metadata at some time prior to managingthe portable program modules and stores the EPG metadata in a storagedevice, such as the portable program module storage 322.

In another example, the metadata decoder 312 can send continuousmetadata updates to the portable program module manager 314, such as inthe case of closed captioning text. As the metadata decoder 312 decodesthe closed captioning text from the television signal 302, the metadatadecoder 312 sends the closed captioning text to the portable programmodule manager 314.

The portable program module manager 314 uses the metadata 313 to managethe life cycle of the portable program modules currently being displayedin the audio and video signal with portable program module overlay 304.For example, if the user changes the channel, the channel change isreflected in the metadata 313 and the portable program module manager314 can perform a new search query using the new channel and EPGinformation associated with the current time and the new channel. In oneexample, if the portable program module manager 314 is currentlydisplaying a portable program module that is no longer included in thenew search results, then the portable program module manager 314 canremove the portable program module from the audio and video signal withportable program module overlay 304. In some implementations, theportable program module manager 314 prompts the user to accept theremoval of the portable program module that no longer satisfies thesearch query.

In some implementations, the portable program module manager 314publishes data to which the portable program modules being displayed cansubscribe. For example, the portable program module manager 314 canpublish the metadata 313 from the metadata decoder 312 or the out ofband metadata. In another example, the portable program module manager314 can publish text or objects recognized from the video in thetelevision signal 302 and/or text recognized from the audio in thetelevision signal 302. In some implementations, the text and/or objectrecognition of the video or audio can be performed by a remote system.In another implementation, the portable program module manager 314 canperform text and/or object recognition of the video or audio.

A portable program module can subscribe to a stream including thepublished data. The portable program module can then use the publisheddata, such as in translating text into another language. In anotherexample, the portable program module manager 314 can publish othertelevision programming related information, such as an identifier of thechannel or television program being presented.

In some implementations, the portable program module manager 314 canpublish information related to the user, such as a location of the user(e.g., a city or postal code), television program viewing preferences ofthe user, or other user information. In some implementations, theportable program module manager 314 only publishes user information uponrequest by the user. For example, the portable program module manager314 can prompt the user for confirmation each time a portable programmodule requests subscription to user information or other information.In another example, the portable program module manager 314 can apply aconfirmation to all portable program modules or a group of portableprogram modules, such as a group from the same Internet domain or fromthe same author.

FIG. 4 is a flow chart that shows an example of a process 400 formanaging the lifecycle of television portable program modules. Theprocess 400 may be performed, for example, by a system such as thesystems 100 and 200, and the portable program module management device300. For clarity of presentation, the description that follows uses thesystems 100 and 200, and the portable program module management device300 as the basis of examples for describing the process 400. However,another system, or combination of systems, may be used to perform theprocess 400. The process 400 begins with receiving (402) metadatarelated to television programming being presented to a user. Forexample, the portable program module management device 106, the portableprogram module management device 202, and/or the portable program modulemanagement device 300 can receive metadata, such as the current channel,EPG data, or closed captioning text, from sources such as the metadatadecoder 312 and/or the search system 108, the search system 210, oranother remote server.

The process 400 identifies (404) a portion of the received metadata asincluding information regarding a condition for portable program moduleselection. For example, the portable program module management device106, the portable program module management device 202, and/or theportable program module management device 300 can identify a time anddate, a program identifier or name, closed captioning information, achannel identifier or name, actor and/or actress names, and/or a genreof the television program being presented.

The process 400 sends (406) a first search request that includes theidentified portion of the received metadata to a search system forselecting one or more portable program modules from among multipleportable program modules, where the selected portable program modulessatisfy the condition. For example, the portable program modulemanagement device 106, the portable program module management device202, and/or the portable program module management device 300 can send asearch query, including metadata related to the television programcurrently being presented, to the search systems 108 and 210. The searchsystems 108 and 210 match portable program modules to one or more pointsof information from the metadata, such as a stock ticker for a financialnews show, or a chat program for an evening drama aimed at teenagers. Insome examples, the search results may include more portable programmodules that satisfy the condition based on the information in theidentified portion of the received metadata than can be selected. Inthese cases, the portable program modules selected can be based on oneor more criteria, including portable program modules previously selectedby the user or other users, portable program modules shown to otherviewers of the same television content, and/or other ranking, such aslinks to a portable program module.

The process 400 receives (408) the selected portable program module. Forexample, the portable program module management device 106, the portableprogram module management device 202, and/or the portable program modulemanagement device 300 can receive the selected portable program modulefrom the search system 108 or the search system 210. Alternatively, theportable program module management device 106, the portable programmodule management device 202, and/or the portable program modulemanagement device 300 can receive a link or URL to the selected portableprogram module from a search system and then use the link or URL toretrieve the selected portable program from a network application dataprovider.

The process 400 outputs (410) the selected portable program module to adisplay device for presentation to the user concurrently with thepresentation of the television programming. For example, the portableprogram module management device 202 can output an audio signal and avideo signal, which include an overlay for one or more selected portableprogram modules, to a presentation device, such as the television 204,the personal computer 206, and the wireless video player 208. In someimplementations, the portable program module management device 202outputs the audio signal to a first device (e.g., a sound system) andthe video signal to a second device (e.g., a video system).

The process 400 receives (412) an update to the metadata related to achange in the television programming being presented to the user. Forexample, the portable program module management device 300 can receivethe television signal 302 and/or the user channel request 306. Themetadata decoder 312 can decode the television signal 302 and/or theuser channel request 306 to identify a change in the televisionprogramming being presented to the user, such as a change betweentelevision programs on the same channel, a change between channels, or achange within a television program. The portable program module manager314 receives the identified change in an update to the metadata.

The process 400 identifies (414) a portion of the received update asincluding information regarding the condition for portable programmodule selection. For example, the portable program module manager 314can identify a channel identifier, television program identifier, orother information, such as a transcript of the television program or aname of an actor.

The process 400 sends (416) a second search request that includes theidentified portion of the received update to the search system. Forexample, the portable program module management device 106 can send asearch query to the search system 108. The search query includes themetadata related to the television program currently presented to theuser, such as a channel identifier, a television program identifier, orother metadata related to the television program.

The process 400 receives (418) results of the second search request andbased on the results determines that the portable program module beingpresented to the user no longer satisfies the condition based on theinformation in the identified portion of the received update. Forexample, the portable program module manager 314 can compare a list ofthe portable program modules that are currently included in theaudio/video overlay to a list of portable program modules in the searchresults from the search system. If a portable program module is nolonger included in the search results, then the portable program moduleno longer satisfies the search condition. For example, if a fund raisingportable program module is displayed while a local public televisionprogram is playing, a change to a national broadcast channel could causethe fund raising portable program module to no longer satisfy thechannel search condition. In some implementations, the portable programmodule manager 314 can prompt the user to confirm the removal of theportable program modules that no longer satisfy the conditions in thesearch query.

The process 400 ceases (420) the output of the portable program moduleupon the determination that the portable program module no longersatisfies the condition. For example, in the above example, the fundraising portable program module can be terminated. In someimplementations, the portable program module manager 314 can add anotherportable program module that does satisfy the search condition to theresulting space created by removing the fund raising portable programmodule. The process 400 can repeat one or more steps. For example, theprocess can receive (402) metadata again. In some implementations, oneor more steps can be performed concurrently. For example, the process400 can receive (402) metadata that results in the display of a firstportable program module and receive (412) a metadata update that resultsin ceasing the output of a second portable program module.

FIG. 5 is a schematic diagram that shows an example of a computingsystem 500. The computing system 500 can be used for the operationsdescribed in association with any of the computer-implement methods andsystems described previously, according to some implementations. Thecomputing system 500 includes a processor 510, a memory 520, a storagedevice 530, and an input/output device 540. Each of the processor 510,the memory 520, the storage device 530, and the input/output device 540are interconnected using a system bus 550. The processor 510 is capableof processing instructions for execution within the computing system500. In some implementations, the processor 510 is a single-threadedprocessor. In some implementations, the processor 510 is amulti-threaded processor. The processor 510 is capable of processinginstructions stored in the memory 520 or on the storage device 530 todisplay graphical information for a user interface on the input/outputdevice 540.

The memory 520 stores information within the computing system 500. Insome implementations, the memory 520 is a computer-readable medium. Insome implementations, the memory 520 is a volatile memory unit. In someimplementations, the memory 520 is a non-volatile memory unit.

The storage device 530 is capable of providing mass storage for thecomputing system 500. In some implementations, the storage device 530 isa computer-readable medium. In various different implementations, thestorage device 530 may be a floppy disk device, a hard disk device, anoptical disk device, or a tape device.

The input/output device 540 provides input/output operations for thecomputing system 500. In some implementations, the input/output device540 includes a keyboard and/or pointing device. In some implementations,the input/output device 540 includes a display unit for displayinggraphical user interfaces.

The features described can be implemented in digital electroniccircuitry, or in computer hardware, firmware, software, or incombinations of them. The apparatus can be implemented in a computerprogram product tangibly embodied in an information carrier, e.g., in amachine-readable storage device or in a propagated signal, for executionby a programmable processor; and method steps can be performed by aprogrammable processor executing a program of instructions to performfunctions of the described implementations by operating on input dataand generating output. The described features can be implementedadvantageously in one or more computer programs that are executable on aprogrammable system including at least one programmable processorcoupled to receive data and instructions from, and to transmit data andinstructions to, a data storage system, at least one input device, andat least one output device. A computer program is a set of instructionsthat can be used, directly or indirectly, in a computer to perform acertain activity or bring about a certain result. A computer program canbe written in any form of programming language, including compiled orinterpreted languages, and it can be deployed in any form, including asa stand-alone program or as a module, component, subroutine, or otherunit suitable for use in a computing environment.

Suitable processors for the execution of a program of instructionsinclude, by way of example, both general and special purposemicroprocessors, and the sole processor or one of multiple processors ofany kind of computer. Generally, a processor will receive instructionsand data from a read-only memory or a random access memory or both. Theessential elements of a computer are a processor for executinginstructions and one or more memories for storing instructions and data.Generally, a computer will also include, or be operatively coupled tocommunicate with, one or more mass storage devices for storing datafiles; such devices include magnetic disks, such as internal hard disksand removable disks; magneto-optical disks; and optical disks. Storagedevices suitable for tangibly embodying computer program instructionsand data include all forms of non-volatile memory, including by way ofexample semiconductor memory devices, such as EPROM (erasableprogrammable read-only memory), EEPROM (electrically erasableprogrammable read-only memory), and flash memory devices; magnetic diskssuch as internal hard disks and removable disks; magneto-optical disks;and CD-ROM (compact disc read-only memory) and DVD-ROM (digitalversatile disc read-only memory) disks. The processor and the memory canbe supplemented by, or incorporated in, ASICs (application-specificintegrated circuits).

To provide for interaction with a user, the features can be implementedon a computer having a display device such as a CRT (cathode ray tube)or LCD (liquid crystal display) monitor for displaying information tothe user and a keyboard and a pointing device such as a mouse or atrackball by which the user can provide input to the computer.

The features can be implemented in a computer system that includes abackend component, such as a data server, or that includes a middlewarecomponent, such as an application server or an Internet server, or thatincludes a front-end component, such as a client computer having agraphical user interface or an Internet browser, or any combination ofthem. The components of the system can be connected by any form ormedium of digital data communication such as a communication network.Examples of communication networks include, e.g., a LAN (local areanetwork), a WAN (wide area network), and the computers and networksforming the Internet.

The computer system can include clients and servers. A client and serverare generally remote from each other and typically interact through anetwork, such as the described one. The relationship of client andserver arises by virtue of computer programs running on the respectivecomputers and having a client-server relationship to each other.

Although a few implementations have been described in detail above,other modifications are possible. In addition, the logic flows depictedin the figures do not require the particular order shown, or sequentialorder, to achieve desirable results. In addition, other steps may beprovided, or steps may be eliminated, from the described flows, andother components may be added to, or removed from, the describedsystems. Accordingly, other implementations are within the scope of thefollowing claims.

What is claimed is:
 1. A computer-implemented method for managing alifecycle of portable program modules, the method comprising: causing,using a computing device that includes a hardware processor, arepresentation of a first application to be presented, wherein the firstapplication is related to a first object identified in a first mediacontent item that is currently being presented; determining that thefirst media content item being presented has changed to a second mediacontent item; and causing the representation of the first application tocease being presented and replacing the representation of the firstapplication with a second application that is related to a second objectidentified in the second media content item being presented.
 2. Themethod of claim 1, further comprising determining that a first pluralityof applications related to the first media content item that is beingpresented, which includes the first application, is available fordownload on the computing device.
 3. The method of claim 1, furthercomprising determining that a second plurality of applications relatedto the second media content that is being presented, which includes thesecond application, is available for download on the computing device.4. The method of claim 1, further comprising determining that the firstapplication does not relate to the second media content item beingpresented.
 5. The method of claim 1, further comprising: determiningfirst metadata related to the first media content item being presented;sending a first search request that includes at least a portion of thefirst metadata to a search system; and in response to the first searchrequest, receiving first search results from the search system thatidentifies the first application, wherein the first applicationcorresponds to the first metadata.
 6. The method of claim 1, furthercomprising: determining second metadata related to the second mediacontent item being presented; sending a second search request thatincludes at least a portion of the second metadata to the search system;and in response to the second search request, receiving second searchresults from the search system indicating that the first application isnot related to the second media content item and that the secondapplication is related to the second media content item.
 7. The methodof claim 1, further comprising: extracting captioning information fromthe first media content item being presented; transmitting a query to anapplication source that includes a plurality of applications, whereinthe query includes at least a portion of the extracted captioninginformation; and receiving the representation of the first applicationbased on the query.
 8. The method of claim 1, wherein the first mediacontent item and the second media content item are presented on apresentation device that is associated with the computing device.
 9. Themethod of claim 1, further comprising: determining first metadatarelated to the first media content item being presented; and searchingthrough locally stored applications on the computing device for thefirst application that has been installed on the computing device.
 10. Asystem for managing a lifecycle of portable program modules, the systemcomprising: a memory; and a hardware processor that, when executingcomputer-executable instructions stored in the memory, is configured to:cause a representation of a first application to be presented, whereinthe first application is related to a first object identified in a firstmedia content item that is currently being presented; determine that thefirst media content item being presented has changed to a second mediacontent item; and cause the representation of the first application tocease being presented and replacing the representation of the firstapplication with a second application that is related to a second objectidentified in the second media content item being presented.
 11. Thesystem of claim 10, wherein the hardware processor is further configuredto determine that a first plurality of applications related to the firstmedia content item that is being presented, which includes the firstapplication, is available for download on the computing device.
 12. Thesystem of claim 10, wherein the hardware processor is further configuredto determine that a second plurality of applications related to thesecond media content that is being presented, which includes the secondapplication, is available for download on the computing device.
 13. Thesystem of claim 10, wherein the hardware processor is further configuredto determine that the first application does not relate to the secondmedia content item being presented.
 14. The system of claim 10, whereinthe hardware processor is further configured to: determine firstmetadata related to the first media content item being presented; send afirst search request that includes at least a portion of the firstmetadata to a search system; and in response to the first searchrequest, receive first search results from the search system thatidentifies the first application, wherein the first applicationcorresponds to the first metadata.
 15. The system of claim 10, whereinthe hardware processor is further configured to: determine secondmetadata related to the second media content item being presented; senda second search request that includes at least a portion of the secondmetadata to the search system; and in response to the second searchrequest, receive second search results from the search system indicatingthat the first application is not related to the second media contentitem and that the second application is related to the second mediacontent item.
 16. The system of claim 10, wherein the hardware processoris further configured to: extract captioning information from the firstmedia content item being presented; transmit a query to an applicationsource that includes a plurality of applications, wherein the queryincludes at least a portion of the extracted captioning information; andreceive the representation of the first application based on the query.17. The system of claim 10, wherein the first media content item and thesecond media content item are presented on a presentation device that isassociated with the computing device.
 18. The system of claim 10,wherein the hardware processor is further configured to: determine firstmetadata related to the first media content item being presented; andsearch through locally stored applications on the computing device forthe first application that has been installed on the computing device.19. A non-transitory computer-readable medium containingcomputer-executable instructions that, when executed by a processor,cause the processor to perform a method for managing a lifecycle ofportable program modules, the method comprising: causing arepresentation of a first application to be presented, wherein the firstapplication is related to a first object identified in a first mediacontent item that is currently being presented; determining that thefirst media content item being presented has changed to a second mediacontent item; and causing the representation of the first application tocease being presented and replacing the representation of the firstapplication with a second application that is related to a second objectidentified in the second media content item being presented.